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A.  Statement  of  problem  studies 

The  filtering  problem  considered  here  is  based  on  the  following  signal  observation  model: 

f  dx(t)  =  f{x{t))dt  +  g(x{t))dv{t)  a:(0)  =  xq  ,  v 

\  dy{t)  =  h{x{t))dt  +  dw{t)  y(0)  =  0 

in  which  x,  v,  y  and  w,  are,  respectively,  R”,  R^,  R”"  and  R^  valued  processes,  and  v  and 
w  have  components  which  are  independent,  standard  Brownian  process.  We  further  assume 
that  n  =  p,  f,  h  are  C°°  smooth,  and  that  g  is  an  orthogonal  matrix.  We  will  refer  to  x{t) 
as  the  state  of  the  system  at  time  t  and  y(t)  as  the  observation  at  time  t. 

Let  p{t,  x)  denote  the  conditional  probability  density  of  the  state  given  the  observation 
{y{s);0  <  s  <t}.  It  is  well-known  that  p{t,x)  is  given  by  normalizing  a  function,  cr(t,x), 
which  satisfies  the  following  Duncan-Mortensen-Zakai  equation: 


m 

da{t,  x)  =  Locr(t,  x)dt  +  ^  Lia{t,  x)dy{t),  a(0,  x)  =  ao  (2) 

i=l 


where 


and  for  i  —  1, ...  ,m,  Li  is  the  zero  degree  differential  operator  of  multiplication  by  hj.  (Tq  is 
the  probability  density  of  the  initial  point,  Xq. 

Equation  (2)  is  a  stochastic  partial  differential  equation.  In  real  applications,  we  are 
interested  in  constructing  robust  state  estimators  from  observed  sample  paths  with  some 
property  of  robustness.  Davis  studied  this  problem  and  proposed  some  robust  algorithms. 
In  our  case,  his  basic  idea  reduces  to  refining  a  new  unnormalized  density 


u{t,  x)  =  exp  [  -  ^  hi{x)yi{t)  j  cr(t,  x). 


i=l 


It  is  easy  to  show  that  u{t^  x)  satisfies  the  following  time  varying  partial  differential  equation 


du ,  . 


u(0,  x)  = 


Lou{t,x)  +  y^yi{t)[LQ,Li\u{t,x) 

i=l 

j  m 

^  Li], Lj]u(t, x) 

i,j=l 

0-0 


where  [Lq,  Li]  denotes  the  Lie  bracket  of  Lq  and  Li. 

The  problem  is  to  solve  explicitly  equation  (3)  in  real-time. 


(3) 
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B.  Summary  of  the  most  important  results 

(I)  In  [Mil],  Mitter  pointed  out  that  the  innovation  approach  to  nonlinear  filtering  theory  is 
not,  in  general,  explicitly  computable.  It  was  first  proposed  by  Brockett  and  Clark  [Br-Cl], 
Brockett  [Br],  and  Mitter  [Mil]  to  use  estimation  algebras  to  construct  finite-dimensional 
filters.  The  idea  is  to  use  the  Lie  algebraic  method  to  solve  the  Duncan-Mortensen-Zakai 
(DMZ)  equation,  which  is  a  stochastic  partial  differential  equation.  By  working  on  the  robust 
form  of  the  DMZ  equation,  we  can  reduce  the  complexity  of  the  problem  to  that  of  solving 
a  time-variant  partial  differential  equation. 

In  the  past  decade,  the  Lie  algebriac  viewpoint  has  been  remarkably  successful,  and  recent 
works[T-W-Y],  [D-T-W-Y],  [Ya],  [Ch-Ya],  [Ch-Yal],  [Ch-Ya2],  [C-L-Yl],  [C-L-Y2],  [Hu-Ya2], 
[Hu-Ya3],  [Wo-Ya]  have  given  us  a  deeper  understanding  of  the  DMZ  equation,  which  was 
essential  for  progress  in  nonlinear  filtering  as  well  as  in  stochastic  control.  In  fact  it  was 
Yau  (cf.  [Yal],  [Ya2])  who  first  used  Lie  algebraic  method  to  discover  the  most  general  class 
of  finite  dimensional  filters  which  include  linear  filters  and  exact  filters  as  special  cases.  In 
[Ch],  this  general  class  of  finite  dimensional  filters  are  called  Yau  filters. 

In  spite  of  the  success  of  the  Lie  algebra  method,  it  is  extremely  desirable  to  treat  the 
DMZ  equation  by  a  direct  method. 

Despite  its  usefulness,  the  Kalman-Bucy  filter  is  not  perfect.  One  of  its  weaknesses  is  that 
it  needs  a  Gaussian  assumption  on  the  initial  data.  The  situation  is  more  complex  when  the 
statistics  of  the  initial  condition  are  modeled  by  an  arbitrary  distribution.  In  the  case  where 
the  linear  filtering  system  (i.e.,  /,  g,  and  h  are  linear  functions  in  (1)  is  completely  reachable 
and  completely  observable,  Hazewinkel  observed  on  p.  115  of  [Ha]  that  the  estimation  algebra 
E  (i.e.,  a  Lie  algebra  generated  by  differential  operators  Lq,  hi{x), . . . ,  hm{x))  is  the  2n  -1-  2 
dimensional  Lie  algebra  with  basis  Lq,  . . . ,  Xi,...,Xn,  1.  Even  in  this  case,  the  Wei- 

Norman  approach  used  to  find  the  solution  of  (3*)  is  more  complicated  than  the  procedure 
in  Theorem  1  below  because  not  only  must  one  solve  a  finite  system  of  ordinary  differential 
equation  and  a  Kolmogorov  equation,  but  also  one  has  to  integrate  n  partial  differential 
equations  corresponding  to  the  operators  . . . ,  More  important,  if  the  linear  system 
is  not  completely  reachable  or  completely  observable,  then  the  basis  of  the  estimation  algebra 
is  not  explicitly  known  (although  it  can  be  computed).  .As  a  result,  there  is  an  additional 
disadvantage  of  the  Wei-Norman  approach,  namely,  one  cannot  write  down  the  finite  system 
of  ordinary  differential  equation  explicitly  in  the  non-maximal  rank  case.  The  novelty  of 
Theorem  1  is  that  our  finite  system  of  ordinary  differential  equations  is  explicitly  written 
down  and  our  procedure  to  get  the  solution  of  (3)  is  simpler  than  the  Lie  algebra  approach. 
Most  importantly,  our  theorem  works  for  Yau  filtering  system  which  includes  linear  filtering 
system  and  exact  filtering  system  as  special  cases. 

Theorem  1  Consider  the  Yau  filtering  system  (1)  with  arbitrary  initial  condition,  i.e., 

OF  ^  ^ 

(Yl)  fi{x)  =  efix)  -f-  ^{x),  1  <i<n,  where  =  '^dijXj  +  dt  for  1  <  i  <  n  and  F  is  a 

j—i 

C°°  function. 
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(Y2)  hi{x)  =  +  Q,  1  <  i  < 


m. 


i=i 


O  £ 

(Y3)  n(x)  E  + E  £ + E  '*?(*)  =  E  TjijXiXj  H“  ^  ^  ^0;  XuflCVS  Tjij  j  Tji  (ITld 

i=l  t=l  1=1  ij=l 

7/0  are  constants. 


i=l 


Choose  a  function  G{x)  such  that 

AG(a:)  +  |  VG|2(a:)  +  2  ^  ^i(x) — (x)  =  77(x)  -  ^  ^?(x)  - 


i=l 


i=l 


2=1 


Then  the  solution  u{t,x)  for  the  Duncan-Mortensen-Zakai  equation  (3)  is  reduced  to  the 
solution  u{t,  x)  for  the  Kolmogorov  equation 

du ,  .  1  .-r  -  { /)  f  \  dG  ,  .N  du  .  ,  V  f  d£i  .  >  d^G .  , 


where 


c{t)+G{x)+f^  ai{t)xi-F{x+b{t))  ,,  \\ 

u{t,x)  =  e  ‘=1  u{t,x  +  b{x)) 


and  ai(t),  bi{t),  and  c{t)  satisfy  the  following  system  o/ODEs;  For  1  <i  <n 

n  m 

bjff)  —  aiif)  —  'y  'djjhjit')  +  ^  ]  Cjiyj if)  =  0 
i=i  j=i 

n  1  ” 

+  '^djib'^{t)-7;Y^{m3+'noi)Ht)  =  ^ 

j=l  ^  3=1 


(4) 

(5) 


2=1 

n 


2=1 

n 


/cj=l 


-E>?if>iW+E'^‘'’!w=°- 


(6) 


Theorem  2  Consider  the  Yau  filtering  system  (1)  with  arbitrary  initial  condition  satisfying 
(Yl),  {Y2)  and  (Y3)  in  Theorem  1.  Then  the  solution  u{t,x)  for  the  Duncan-Mortensen- 
Zakai  equation  (3)  is  reduced  to  the  solution  u{t,  x)  for  the  Kolmogorov  equation 


^it,x)  =  ^Au{t,x)-'^ii{x)^{t,x) 

2=1 


\i=i  i=i  ®  / 
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where 


\  c{t)+'£  ai(t)ti-F(x+b{i)) 

u{t,  x)  =  e  <=i  u{t,  X  + 

and  ai{t),  bi{t)  and  c{t)  satisfy  ODEs  (4),  (5)  and  (6). 

Theorem  3  Consider  the  Yau  filtering  system  (1)  with  arbitrary  initial  condition  satisfying 
(Yl),  (Y2)  and  (Y3)  in  Theorem  1.  Then  the  solution  u{t,x)  for  the  Duncan- Mortensen- 
Zakai  equation  (3)  is  reduced  to  the  solution  u{t,  x)  for  the  Kolmogorov  equation 

— (t.x)  =  -Aw(t,x) -^/i(x)— (t,x) 

i~\ 

\i=l  i=l  *  / 

where 

,  c{t)+'^ai(t)xi+F(x)-F{x+b(t)) 

u{t,  x)  =  e  u{t,  X  + 

and  ai{t),  bi{t)  and  c{t)  satisfy  ODEs  (4),  (5)  and  (6). 

Notice  that  the  explicit  recursive  filter  for  exact  filtering  system  was  previously  derived 
only  for  maximal  rank  case  (i.e.,  rank  of  (cjj)  is  n),  see  [Be]  for  a  particular  maximal  rank 
case  and  [T-W-Y]  for  general  maximal  rank  case.  Our  result  is  an  important  breakthrough 
for  the  last  20  years  because  our  method  works  for  most  general  filtering  systems  and  we  no 
longer  need  maximal  rank  condition  to  construct  explicit  recursive  filter  and  we  can  allow 
arbitrary  condition.  The  significance  of  our  results  are  that  this  estimation  problem  have 
been  factored  into  two  parts:  (1)  the  off-line  calculation  of  the  Kolmogorov  type  equation 
which  does  not  depend  on  the  observations  and  (2)  the  on-line  solution  of  a  finite  linear 
system  of  ordinary  differential  equations,  which  can  be  realized  in  real  time. 

Yau  has  given  several  lectures  in  the  Department  of  Electrical  Engineering,  National 
Cheng  Kung  University,  Tainan,  Taiwan.  Under  Yau’s  direction.  Professor  Yen-Tai  Lai  and 
his  students  has  successfully  implemented  an  ODEs  solver  for  the  Yau  filtering  system.  This 
ODEs  solver  has  three  advantages:  1)  the  data  processing  is  parallel-input  parallel-output  so 
that  it  is  faster  than  other  strategies  of  serial-input  parallel-output;  2)  the  solving  processes 
can  be  divided  by  fan-in  algorithm  that  can  speed  up  the  whole  performance  of  the  ODE 
system  in  Yau  filter,  3)  the  ODEs  solver  can  be  easily  implemented.  This  ODEs  solver 
not  only  can  estimate  the  solution  of  the  ODEs  in  the  Yau  filter,  but  also  can  solve  the 
exponential  problem  required  in  Yau  filter.  The  performance  of  the  ODEs  solver  is  fast 
enough  for  real  applications. 
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Report  of  Inventions 

Yau  has  given  several  lectures  in  the  Department  of  Electrical  Engineering,  National  Cheng 
Kung  University,  Tainan,  Taiwan.  Under  Yau’s  direction.  Professor  Yen-Tai  Lai  and  his 
students  has  successfully  implemented  an  ODEs  solver  for  the  Yau  filtering  system.  This 
ODEs  solver  has  three  advantages: 

1)  the  data  processing  is  parallel-input  parallel-output  so  that  it  is  faster  than  other 
strategies  of  serial-input  parallel-output; 

2)  the  solving  processes  can  be  divided  by  fan-in  algorithm  that  can  speed  up  the  whole 
performance  of  the  ODE  system  in  Yau  filter, 

3)  the  ODEs  solver  can  be  easily  implemented. 

This  ODEs  solver  not  only  can  estimate  the  solution  of  the  ODEs  in  the  Yau  filter,  but 
also  can  solve  the  exponential  problem  required  in  Yau  filter.  The  performance  of  the  ODEs 
solver  is  fast  enough  for  real  applications. 
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